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In certain mean field models for spin glasses there occurs a one step replica symmetry breaking 
pattern. As an example of general 1/iV-corrections in such systems, the fluctuations in the internal 
energy are calculated. For this specific quantity the outcome is known from the specific heat. It is 
shown that the correct result can be derived by assuming that the both the height and the location of 
the breakpoint fluctuate. This effect enlarges the commonly considered space of allowed fluctuations 
■ of the order parameter in loop calculations for short range spin glasses of this type. The phenomenon 

ON ' does not occur in spin glasses with infinite order replica symmetry breaking. 
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I. INTRODUCTION 

The theoretical understanding of the spin glass phase relies on the Parisi replica symmetry breaking scheme. |lj] 
Parisi considered a variational problem with k breakings of replica symmetry. The objects that show up are the values 
of possible overlaps qi (0 < i < k) and their cumulative weights Xi (1 < i < k). The free energy was maximized in 
these variables. In the Sherrington-Kirkpatrick model the physical result arises in the limit k — *■ oo. Eliminating the 
i's a continuous order parameter function q(x) arises. Loop corrections to this mean field theory have been studied 
in great detail in a series of papers by de Dominicis, Kondor and Temesvari. In particular, the fluctuation matrix 
has been inverted in full glory. || 

Many aspects of this and related replica analyses are ill defined and often ill understood. Nevertheless replica 
results for the SK-model have been rederived by TAP-analysis and cavity methods. Q For the random energy model 
( "simplest spin glass" ) the replica results are in full agreement with the direct evaluation of the partition sum. |^ 

It is our belief that a replica analysis can produce the physically correct answer in a quick way, but its interpretation 
should always be understood from a more profound analysis. If the anwer is unsatisfactory, then one should simply 
abandon it or improve the derivation (the celeber case being Parisi's improvement of the Sherrington-Kirkpatrick 
saddlepoint.) Such a situation occurs in particular in systems which exhibit one step of replica symmetry breaking 
\ (1RSB). Here there occur two transition temperatures, T g for the statics and T c > T g for the dynamics. 

Kirkpatrick and Wolynes J| considered the Potts glass, which exhibits a 1RSB when the number of components 
. £h ! exceeds four. In their analysis of the metastable states (TAP states) they observed that there occurs a critical 
temperature T c > T g where unexpected behavior sets in. On a static level the system condenses for T g < T < T c in a 
multitude of states with extensive complexity, all of which have non-zero self-overlap but vanishing mutual overlap. 
The free energy is therefore still equal to the paramagnetic free energy. As a result, this transition is not noticed in a 
direct replica analysis of the partition sum when one uses Parisi's prescriptions. Nevertheless, it can be described by 
replica's if one modifies the rule for fixing the breakpoint. The value of the selfoverlap can be obtained by solving the 
equation dF/dqi = 0, with the additional rule that the limit x\ — > 1 is taken afterwards. In this temperature interval, 
namely, it gives the maximal free energy in the physical range < X\ < 1. Loosely speaking, that limit equates the 
value of the selfoverlap to the mutual overlaps in a limiting small cluster of states. This procedure also automatically 
implies that the free energy of this phase is equal to the paramagnetic one. For T < T g the extremum can no longer 
be located at x± — 1 and the additional restriction has to be relaxed. 

A related mystery of the replica calculus occurs in the dynamical approach to the systems with 1RSB. The prototype 
is the spherical p-spin interaction spin glass, see eq. (1) below. The long-time limit of dynamics has a vanishing 
fluctuation eigenvalue, and is therefore called "marginal". M || |pj. The long-time dynamical values for q\ and x\ can 
be derived from the replica free energy by assuming marginality within the replica calculation Rj M jl0| . The mystery 
remains why a replica calculation can explain the long-time dynamics. After all, the Gibbs weight is thought to be 
related to exponentially large times where the system has time enough to visit all states. Marginality is thought to 
be related to algebraically large times. It therefore seems paradoxical that Gibbs weight at marginality does describe 
the results of long time dynamics. It has been suggested that an essential role is played here by the complexity. It is 
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so large that the replica free energy is the lowest of the available states, an old thermodynamic law, but new in glassy 



systems. |11 



In this note we wish to draw attention to another aspect of the location of the break points of 1RSB solutions. This 
time we consider the more standard stationary case, where the Parisi description applies, namely the optimal value of 
the break points follows by maximizing the free energy. When calculating 1 /N contributions to a physical quantity, 
we find that care should be taken of fluctuations in the location of the plateaus. 

In next section we present in detail the calculation of the fluctations of the internal energy in a p-spin interaction 
mean field spin glass model with 1RSB. Subsequently this analysis is generalized to models with ooRSB. The paper 
closes with a discussion. 

II. ANALYSIS OF A MODEL WITH 1RSB 

For a system with N spins in zero field we consider the Hamiltonian 

H = — y y Ji 1 i 2 ...i p Si 1 Si 2 ■ ■ ■ Si p (1) 

il<i2<---<i P 

with independent Gaussian random couplings, that have average zero and variance J pl/2N p . The spins are 
spherical and subject to the condition ^ ■ Sf = N. A replica calulation was performed by Crisanti and Sommers 
(CS). @ The replicated free energy reads 

a/3 

At zero field the order parameter function has the one-step form q(x) = q\6{x — x\), and the free energy reads 
F (U 2 8J 2 P t m 

N=-— + ~ 2x\ l0g(1 _ + ^7 l0g(1 _ ^ (3) 

where £i = 1 — X\. The internal energy reads 

t,_-*£V 6 ,D (4, 

Following Crisanti and Sommers in their TAP-approach p|, we denote by z the value < z < y / '2/p(p — 1) where 
the complexity 

N (2-p pz 2 p-1 2 2 \ 

I = Y{—- log — + — z -p^) (5) 

is non-extensive, viz. I/N — 0. The equations dF/dqi — dF/dxi = then can be cast in the form 

P(l - q)(fi = z; xi = 6) 

pz A qi 

From these results one can calculate the specific heat C = dU/dT using 

dqi = 2/3gi(l-gi) 
dT p —2— pqi 

One obtains 



(7) 



c .g^( 1 - { ,rf-^ w.< m -, + m (8) 

2 V pqi-p + 2 J 

Let us now consider the fluctuations in the internal energy, 

AU 2 = (H 2 ) - (H) 2 = - f DSH(S a )H{S )exp ( -/3^H(5 7 ) J (9) 

71 a,/3=l^ V 7=1 / 
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where the last relation involves replicas, and the limit n — » is implied. The leading terms in N are of order N 2 n, so 
they donot survive for n — ► 0. Indeed, U is expected to have fluctuations of relative order 1/y/N. 

The first O(N) contribution to AU 2 comes when all sites in the pre-exponentials overlap pairwise. It yields 



A f/2(1) 



J 2 N^ p 
2n 

a/3 



J 2 N 



Before calculating the other terms one has to average over the couplings. It implies the shift 



2NP 



(10) 



(11) 



One gets the contribution 

(2) = ^Wp!p! v 



E 



af3jS i 1 <i 2 <---<i p i' x <i' 2 <—<i' p 

where the replicated exponential reads 



dpdq 
2iri 



i\ l\ ip ip %^ £j 



■S^Sle-PX* 
i p l P 



(12) 



-0H„ 



expj] 

a/3 



(13) 



2 r M " ' 2 

and dpdq/2m is a short hand for the integration measure Y\ a< p[dp a pdq a p/2'iTi]Y\ a [dp aa /2'Ki\ x (1 + 0(n)), while 
further p and q are symmetric. [[l2) It is indeed seen that the leading terms in N are of order N 2 n, so they donot 
contribute when n = 0. 

We can now express the prefactors as q's and carry out the spin integrals, to obtain 



AU 



2(2) = ^W 

An 



f dpdq r ip 
J Zm z — ' 



a{3~f5 



E 

a(3 



N 
~2 



P 2j2 €tl3 + '—Pa(3q a f3 \ ~ ^trlogp 



N. 

~2 



(14) 



Expanding around the saddlepoint one sets q a p = q a! 3 + 8q a j3, p a p — p a p + 8p a p, with 5q aa = 0, where q and p = q^ 1 
momentarily denote the saddle point values. One can then integrate out the <5p's, so that only the fluctuations in the 
g's remain 



/3 2 J 4 iV 2 f —TV . 

A = An\det(vm/ 2 / dq E 9S 7 ^exp— ^ Sq a0 M af3nS Sq- (6 



(15) 



where M a p^$ = d 2 f3F n /dq a pdq~ ( 5 is the fluctuation matrix. Its matrix elements and eigenvalues arc discussed by 
Crisanti and Sommers Jl2[ . 

Now one can go to eigenmodes of M. |Q The transversal ones can be integrated out, which brings the square 
root of a another determinant as prefactor. At fixed break point x\ only the longitudinal eigenvector 8q a p ~ q a f3 will 
contribute due to the contraction in the preexponential. However, also g's with a small shift in the breakpoint will 
be seen to contribute. Jl3| We therefore consider fluctuations described by order parameter functions 



<7a/3 -> q(x) = (1 + rj)qi9(x -Xi-8) 



(16) 



where q\ and x\ are the saddlepoint values, and where r\ gives fluctuations in the height of the plateau and 5 in the 
location of the breakpoint. 

The shape ( |l6| ) of q(x) leads to n-times the free energy (||) with qi — > qi(l + rj) and x\ — > x\ + <5. The value at 
5 = 77 = is of order n and has been omitted already from eq. (|l5|). The linear terms vanish due to the saddlepoint 
condition, and were also omitted already. The quadratic terms therefore yield immediately 



^ 8q a pM a i 3 . 1 s5q 1 s -* n {tfq\fiF qq + 2r]8qil3F qx + 8 2 (3F X 

a.{3-f5 



(17) 



We now assume that for n — > the summation over different breakpoints can be replaced by an integral over their 
location x\ + 5 viz. J w\{x\ + 8)d(xi + 8), where w\ is an unknown but smooth weight. Since 8 is of order 1/yN, it 
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then follows that its weight wi(xi + 5) « w{x\) is uniform in 5. The total weight w consists of w\ and of square roots 
of determinants that arise after performing the Sp integrals and the transversal Sq modes. Next we assume that w is 
such that the remaining Gaussian integral over 6 and r\ is normalized to unity. One then has 

AU 2 (2) = P 2 J A N 2 n J d V dS[l - + Sq{ - p^ m {] 2 exp {y 2 q 2 (3F qq + 2 V 6 qi (3F qx + S 2 (3F XX ) 

4 JdjjdSe^p^fi (r) 2 q*j3F qq + 2r,S qi l3F qx + S 2 f3F xx ) 1 ' 

Let us recall that the appearence of the integral in the denominator is due to our assumed value of w, now seen to 
be of order Nn. As the Gaussian fluctuations bring a factor 1/Nn, they indeed yield terms that survive in the limit 
n — > 0. There are several fluctuation contributions. We should only take into account the cross terms [Sq^ — p^ii]qi] 2 . 
This yields 

A[f 2 (2) = P mi ^2^ _ 2p ^ qiRgx + q 2 iRxx) (19) 

where R is the inverse fluctuation matrix, viz. — f3Fij, with i = q,x; j = q,x. Inserting the field equations 

dF/dqi = dF/dxi = one has 



<i[(p - l)gi ~P + 2 + ^igi(p - 1 - pqi) 
2(1-^(1-^)2 



2(l- qi )(l-Z iqi ) 

-gi(P9i ~ gi - 
2p(l ~ q 1 )x 1 (l - ( iqi ) 2 



= 7 KMl ~^) q r" + S (22) 



The inverse matrix reads 



-2(l- gi )(l-g lgl ) 
(2 - p + Pqi )[{p - l) qi - £ iqi - p + 2] ' 



% = To i \u V roT^y (23) 



S qq =^—^{j> q i-2i iqi -p + 2) (24) 

S^z = pXi(l - <?i) (25) 

S** = ^ [(p - 1)®. - p + 2 + fat {P ~ 1 - Mi)] (26) 
1i 



Now one only has to insert these results in (|T^). One obtains 

■nn, — m-4- 1 VI 

(27) 



A[/2(2 ) = J 2 iVgf[l-6(pgi-P + l)] 



Mi - P + ^ 

Note that several unpleasant denominators have canceled, affirming that that our procedure is correct. Putting things 
together we find 

AU 2 = AU 2 W + AU 2 ^ = ^(l- fcrf - ^l-^i-P+l)^ (28) 

2 V pqi-p + 2 J 

Comparing with eq. (|^) one sees that indeed AU 2 = T 2 dU/dT, as required by a standard thermodynamic relation. 
If variations in x\ had not been taken into account, AU 2 would have been proportinal to 1/F qqi which is certainly 
incorrect, since the complicated factor in the nummerator of F qq will not be canceled. 



III. INFINITE ORDER REPLICA SYMMETRY BREAKING 



Recently the author proposed a spherical model with infinite order replica symmetry breaking. It is the model 
given by eq. ([!]), but summed over p. |l5] | In particular, random pair (p = 2) and random quartet interactions (p = 4) 
occur, while random triplets should be absent. Then the model has near the spin glass transition the same critical 
behavior as the Sherrington-Kirkpatrick model. Its benefit is that it can be solved explicitly in the whole low T phase; 
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this arises due to the spherical nature of the spins and the mean field character of the model. For our present purpose 
this allows an explicit check at any temperature in a model with infinite RSB. 

Assuming that the variance of the p-spin couplings equals Jp{p— l)!/iV p_1 , the free energy for a fc-step RSB pattern 
can be derived using results of an appendix of CS 



where 



" Jl 

p=2 



and 



k 



* = ^2(xi+i - Xi)f(qi); Ai = 1 - q k + ^2 x Alj - H-i) ( 31 ) 

i=0 J=i+1 

As usual we defined xo = and Xk+i = 1. The variables {eft, x{\ will be denoted by a 2k + 1 component vector vt, 
(i = 0, • • • , 2k). From U = — (/3AT/2)(/(l) — $) one obtains by differentiation with respect to T the specific heat 



R 2 N R^N 2fc 

C = ^{f{l) -$) + VE ( 32 ) 
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i,j=0 

where i?" 1 = d 2 !3F/dv i dv J and <J>i = d^/dvi. 

We again consider the fluctuations in the internal energy. The analog of eq. ([n]) immediately explains the first two 
terms of T 2 C. The analog of eq. ( |l9|) is 

AL^ 2 > = ^f>i?^ (33) 



Multiplied by j3 2 this indeed equals the last term in eq. (p2[). 

Our approach thus reproduces the correct result for the fluctuations of the internal energy at any fixed k and, 
in particular, in the physical limit k —> oo. In this continuum limit the meaning of the breakpoints Xi becomes 
ill-defined. It was conjectured by Parisi jl6| that the discussed effect then disappears. In other words, the final result 
might be due to fluctuations in the plateaus qi only. In order to investigate this question we go to the Parisi free 
energy functional for the SK model M 

k 

(3F = £> i+1 - Xi ) (Ig? - jQiTi + y±ql) (34) 

i=0 

where the paramagnetic background has been subtracted, r = ({3 2 J 2 — l)/2, and 

^ fe ^ i — 1 

Ti = -{2x i+ i - x t )q 2 + qi ^2 ( x i +1 ~ + 2 ~ x ^ (35) 

j=i+l j=0 

For this model eq. ( j32[) still applies with f(q) = J 2 q 2 , while the term involving / (I) = J 2 comes from the paramagnetic 
background. 

The nice thing of the Parisi model is that the solution for qi, x% is known exactly at any k. It holds that 

2i + l . 6yi(? fc 

* = 2*+I ft Xi = i ^TT) (36) 

where qk satisfies 
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yiql {l-j2kTW)- wqk + T = (37) 

This is an immediate, exact generalization of the Parisi solution of the model ( |34]) to the region where ryi/w 2 is not 
very small. 

From Parisi's results it follows that now 

(3J 2 N A 2 _^J 2 JV/ 2 8yifc(fc + l) 3 



iv 2 ijj iv / 2 oj/ik^k; -t- i; 3 \ , s 

17 = 2^(^+1 - »i)gt = ~^r~ \ qk ~ w (2k + l) 2 qk I ( ] 



i=0 

Differentiating with respect to T one finds that AC/ 2 ( 2 ) should be equal to 



AU 2 (2) = _0^Nqu w - y^(3 - (2fc+Tp-) (39) 



U> - yiq fc (3 - I 2FFT F ) 



Since this expression converges as l/(2k + l) 2 , a good approximation is already obtained for k = 1. The full result 
for the specific heat converges even as l/(2fc + l) 4 . jlj 

We have also calculated AC/ 2 ( 2 ) by taking into account only the fluctuations in the qi. Numerically we have inverted 
the matrix d 2 (3F / dqidqj up to large sizes (k — 150) and find at w = y\ = 1, t = 0.1 that 

A d<S> ( d 2 (3F \~ 1 A g f d 2 (3F y 1 d$ 0.446 _ non 0.446 

d m \dqd q) d qj ~ 2^ ^ ^7 J . . ^ + (2fcTTF " -°- 4900592 J + (^TIF ( j 

where the sum in the middle involves fluctuations in both q and x, viz. {vi} = {go, 9i, 92, • • • ; asi, X2, ■ • •}• 

From this example it is seen that Parisi's conjecture is probably true in general: the effect of fluctuations of the 
breakpoints disappears for continuous order parameter functions. 



IV. CONCLUSION 



We have put the basis for one-loop calculations in a mean field spin glass model with 1RSB. We calculated the 
energy fluctuations because their strength is known already; they are proportional to the the specific heat. In order 
to reproduce the correct answer, we had to take into account fluctuations in both the height and the location of the 
breakpoint of the 1RSB solution. (It should be admitted that the normalization of the fluctuation integral deserves 
a solid derivation. Our assumed form is the natural one, and leads to the correct results.) Il3| 

It is the new point of this paper that in integrating over all q a {3 one must not only integrate over the fluctuations 
around the saddlepoint at given parametrization (given breakpoint x\), but also over all possible parametrizations 
(locations of the breakpoint). In hinsight, this is not so unnatural. In mean field both the location of the breakpoint 
and the plateau value are determined by a saddle point equation. Generally saddle points appear when one has to 
perform sharply peaked integrals. The very notion of a saddle point can only occur due to smallness of fluctuations 
around it. Saddle points without fluctuations do not exist. Fluctuations must always be considered; only in some 
cases they are negligible. 

The new question which arises is: what happens beyond mean field in finite range systems? Physically, the weight 
of the 1RSB solution is the probability for occurrence of non-zero overlap. At before hand, there is no reason why it 
should be constant. One would thus expect that it fluctuates. This is exactly what we showed in an explicit mean 
field calculation. Beyond mean field one expects that it fluctuates in space. In the renormalization group approach 
of Cwilich and Kirkpatrick [jT7f such fluctuations are not taken into account. 

An important question is whether they are compatible with ultrametricity. The answer is affirmative. Indeed, given 
Parisi's division of the replica number n — {n/ xi)(x\/ X2) ■ ■ ■ (x/c/1), one can impose at each lattice sites the allowed 
"ultrametric states" x\, ■ ■ ■ , x&. In mean field only one "state", say x, will be occupied; this happens uniformly in 
space. For describing fluctuations of the breakpoint at site r, the state with breakpoint x(r) — x + Sx(r) will be 
occupied at the cost of the occupation of the state with x. This will modify the longitudinal sector of the fluctuations. 
As this sector is massive at the transition and below, it is expected to bring only quantitative effects, and not to 
change the renormalization flow. | |l7j . 

In models with infinite order replica symmetry breaking the order parameter function has in zero field a continuous 
part up to x = x\ and is constant beyond. Here the effect of fluctuations in the location of the breakpoints was seen 
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to disappear. For short range systems this implies that the breakpoints donot fluctuate in space. The fluctuations 
of the probability of the self-overlap, i.e. 1 — x±, are probably already taken into account by the fluctuations in the 
height of the plateau. 
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